Papers with qualitative text generation
Gaperon: A Peppered English-French Generative Language Model Suite (2026.findings-acl)
Copied to clipboard
Nathan Godey, Wissam Antoun, Rian Touchent, Rachel Bawden, Éric Villemonte de la Clergerie, Benoît Sagot, Djamé Seddah
| Challenge: | Standardized benchmarks have become the dominant metric for measuring progress in large language models, but their validity is compromised by data contamination and unclear relationship between benchmark scores and genuine language understanding. |
| Approach: | They propose to use GAPERON to investigate evaluation dynamics under realistic training conditions. |
| Outcome: | The proposed model outperforms models that excel on benchmarks in qualitative text generation and vice versa. |